Lessons Learned from a Task-based Evaluation of Speech-to-Speech Machine Translation
نویسندگان
چکیده
For several years we have been conducting Accuracy Based Evaluations (ABE) of the JANUS speech-to-speech MT system (Gates et al., 1997) which measure quality and fidelity of translation. Recently we have begun to design a Task Based Evaluation for JANUS (Thomas, 1999) which measures goal completion. This paper describes what we have learned by comparing the two types of evaluation. Both evaluations (ABE and TBE) were conducted on a common set of user studies in the semantic domain of travel planning.
منابع مشابه
In Proceedings of LREC-2000 Lessons Learned from a Task-Based Evaluation of Speech-to-Speech Machine Translation
For several years we have been conducting Accuracy Based Evaluations (ABE) of the JANUS speech-to-speech MT system (Gates et al., 1997) which measure quality and fidelity of translation. Recently we have begun to design a Task Based Evaluation for JANUS (Thomas, 1999) which measures goal completion. This paper describes what we have learned by comparing the two types of evaluation. Both evaluat...
متن کاملThe Effect of Private Speech and Self-Regulation on Translation Quality among Iranian Translation Students: A Mixed-Methods Study
The current study presents findings from a mixed-methods study of investigating the self-regulatory role of private speech (self-talk) on students’ translation quality. The aim of the study was to validate the adapted version of a self-verbalization questionnaire. The construct validity and reliability of the scale were supported by the CFA which revealed that all items reached the acceptable f...
متن کاملThe Relationship between Iranian EFL Learners’ Ambiguity Tolerance and the Accuracy of Their Task-based Oral Speech
Various individual differences, including ambiguity tolerance (AT), have gained momentum because of the influence they can exert on the process and product of learning, and thereby, on various aspects of the learner’s interlanguage system such as accuracy of oral speech. The present study was undertaken to examine the extent to which Iranian EFL learners’ AT was significantly correlated with th...
متن کاملThe Effects of Collaborative Translation Task on the Apology Speech Act Production of Iranian EFL Learners
The present study aims to investigate the relative effectiveness of different types of pragmatic instruction including two collaborative translation tasks and two structured input tasks with and without explicit pragmatic instruction on the production of apologetic utterances by low-intermediate EFL learners. One hundred and fifty university students in four experimental groups and one control ...
متن کاملP65: Speech Recognition Based on Bbrain Signals by the Quantum Support Vector Machine for Inflammatory Patient ALS
People communicate with each other by exchanging verbal and visual expressions. However, paralyzed patients with various neurological diseases such as amyotrophic lateral sclerosis and cerebral ischemia have difficulties in daily communications because they cannot control their body voluntarily. In this context, brain-computer interface (BCI) has been studied as a tool of communication for thes...
متن کامل